PREVIEW DEVICE, ELECTRONIC DEVICE, AND 
IMAGE FORMING APPARATUS 



BACKGROUND OF THE INVENTION 
5 Field of the Invention 

T.he__p.r_e.s_ervt invention relates to a preview device, 
electronic device, and image forming apparatus for allowing 
images such as characters or graphic figures to be previewed 
before output. 

10 

Description of the Related Art 

Conventionally, a printing device is used to print data 

processed by an information processing unit such as a PC 

(personal computer) . 
15 The printing device used here is generally designed to 

print an entire page according to a page layout prepared by 

the information processing unit. 

However, with such aprinting device, since printingpaper 

is actually printed after performing page layout on a screen 
20 of the information processing unit, the actual printout 

sometimes does not match the layout on the screen. Besides, 

it is troublesome to perform page layout on screen. 

To deal with this situation, printing devices provided 

with the capability to preview print position on paper have 
25 been proposed to perform page layout easily. For example, 

a printer described in Japanese Patent Laid-Open No. 6-15920 

is provided with light-emitting capability to indicate print 
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position on printing paper, and thus allows the user to do 
printing at desired positions on the printing paper. 

Also, a document processor described in Japanese Patent 
Laid-Open No. 10-124510 allows the user to edit a document 
by seeing printing paper through a transmissive liquid crystal 
(display placed over the printing paper in order to adjust page 



layout to actual paper in the process of editing a document. 

However, the printer described in Japanese Patent 
Laid-OpenNo . 6-15920 onlyprojects a rectangular mark of light 

10 onto printing paper to indicate print position, and does not 
have the capability to preview detailed conditions such as 
size, shape, and color of content to be printed. 

Also, the document processor described in Japanese Patent 
Laid-Open No. 10-124510 allows the user to edit a document 

15 by seeing it through a liquid crystal display, but does not 
allow the user to preview edited print data to make fine 
adjustments to print data including size adjustment of entire 
content to be printed, parallel or rotational translation, 
color conversion, transformation, etc. 

2 0 Such a problem is commonly encountered when drawing 

characters or graphic figures of predetermined shape in desired 
positions (e.g., when doing embroidery on a sewing machine) . 

The obj ect of the present invention is to make it possible 
to draw an image as intended. 

25 

SUMMARY OF THE INVENTION 
To achieve the above object, the present invention 
provides a preview device, comprising: display section (e.g., 
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an image display unit 20 in FIG. 1) for simulating a state 
where a predetermined image is actually drawn on an 
i.age-forming surface (e.g., a printing surface or a surface 
on which a printed image is pasted) on which a tangible image 
5 is formed (e.g., printing an image directly or pasting a sheet 
with a Printed image) ; and display information acquisition 
section for acquiring display information (e.g., "projection 
plane information" or "projection adjustment values" in 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS ) about 
10 actual display state of the image displayed by the display 
section on the image-forming surface. 

incidentally, the "state where an image is drawn" here 
includes a state where the image is printed and a state where 
a sheet with the image printed is pasted. When an image is 
15 drawn directly on an image-forming surface by printing or the 
like, "projection plane" in DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS matches the image-forming surface. 

Also, the "image" here generally includes line drawings 
such as characters and expressions of other graphic figures. 
20 Furthermore, the "tangible image" here means an image 

which is formed as something tangible when the image is printed 
or a sheet with the image printed is pasted unlike intangible 
im ages such as projected images. Also, the "predetermined 
ima ge" means a concrete image ( image specified to be previewed) 
25 which can be made into a tangible image while the "image 
displayed by the display section" refers to an image resulting 
from a simulation of a state where a predetermined image is 
actually drawn. 
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Incidentally, the phrase "simulating a state where a 
predetermined image is actually drawn on an image-forming 
surface on which a tangible image is formed" widely includes 
displaying a "state where an image is actually drawn" to the 
5 extent that "the viewer can imagine the state accurately." 
.S pec ifically/ it includes the concepts represented by 
expressions such as "displaying a state where an image is 
actually drawn" or "displaying a state which exists when an 
image is actually drawn" or expressions such as "simulating 

10 a state," "imitating a state," or "displaying virtually-" 
Thus, these concepts include, for example, a state where a 
predetermined image is actually drawn on an image-forming 
surface on which a tangible image is formed, with a mark being 
displayed indicating that the image is simulated. 

15 With this configuration, since the display section allows 

the user to verify the state where a predetermined image is 
drawn on the image-forming surface, it is possible to avoid 
situations in which unintended results are produced and improve 
the efficiency with which drawing data is created. Also, since 

20 the preview device is equipped with the display information 
acquisition section, it is possible to modify drawing data 
as required referring to the displayed image. 

Also, the display information contains at least the size 
of the displayed image on the image-forming surface, position 

25 of the displayed image on the image-forming surface, or color 
of the displayed image on the image-forming surface. 

This configuration makes it possible to preview (check 
in advance) colors which are hard to check simply on a display 
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or the like of a PC or the like as well as positions and sizes 
which are particularly difficult to check by a conventional 
method. 

Also, the preview device further comprises correction 
5 section for changing the display state of the image displayed 
-by tiie^ display sect ion on the image-forming surface. 

This configuration makes it possible to check different 
variations of drawing by correcting the display state, and 
thereby ensures optimal drawing results. 
10 Also, the display section simulates a state where an image 

is actually drawn on the image-forming surface by projecting 
light on the image-forming surface. 

This configuration eases restrictions on display 
surfaces and display size greatly andincreases the flexibility 
15 of display drastically. Besides, by projecting images onto 
various display surfaces, it is possible to check results of 
drawing taking into consideration textures on the display 
surfaces . 

Also, the display information acquisition section 
20 acquires the display inf ormationbased on at least the position 
of the display section to the image-forming surface, distance 
of the display section from the image-forming surface, 
projection angle of light projected onto the image-forming 
surface, or color of the image-forming surface. 
25 This configuration makes it possible to acquire various 

parameters needed for projection-based previewing. 

Also, the distance of the display section from the 
image- forming surface is acquired based on the magnification 
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and focal distance of an optical system used by the display 
section to project light. 

This configuration makes it possible to acquire the 
distance to the image-forming surface without using a special 
5 device such as an image sensor, and thus to reduce the 
manufacturing cost of the preview device. 

Also, the display section includes a display which" 
transmits light from one side (the rear side which faces the 
image-forming surface, in this case) to the other side (the 

10 side which is visible on the surf ace, in this case) of a display 
surface where images are displayed and the display section 
simulates a state where a predetermined image is actually drawn 
on the image-forming surface with the display superimposed 
over the image-forming surface. 

15 This configuration makes it possible to preview an image, 

checking it against what has already been drawn on the 
image-forming surface. Thus, if a frame (e.g., a frame for 
a name) has already been drawn specifying what should be drawn 
in it, what is specif ied canbe drawn accurately in the specified 

20 position. 

Also, the preview device is capable of generating drawing 
data (e.g., "print data" in DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS) for drawing the predetermined image 
on the image-forming surface exactly like the simulated 
25 predetermined image. 

This configuration makes it possible to generate drawing 
data needed to draw an image confirmed by preview. 
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Also, the preview device further comprises drawing 
section (e.g., print unit 30 in FIG. 1) for drawing the 
predetermined image tangibly based on the drawing data. 

in other words, the drawing section can tangibly draw 
the image associated with the drawing data. 

Also, the^rawing section draws the predetermined image 
directly on the image-forming surface based on the drawing 



data 



data . 

15 



This configuration makes it possible to draw the image 
10 on the image-forming surface right away after preview. 

Also, the drawing section draws the predetermined image 
on a drawing medium (e.g., a label or large-format printing 
paper) added to the image- forming surf ace, based on the drawing 

This configuration allows an image drawn on a drawing 
medium to be pasted to the image-forming surface even if the 
image cannot be drawn directly on the image-forming surface. 

Also, the drawing section is capable of drawing the 
predetermined image on a plural ity of drawing media by dividing 

20 it into parts. 

This configuration allows a desired image to be drawn 

even on a large-sized image-forming surface. 

Also, the image-forming surf ace contains markers (e.g., 
markers in FIG. 8) which serve as a guide for dividing the 
25 image-forming surface into multiple areas, the display 

information acquisition section acquires the positions of the 
markers on a displayed image, and the drawing section draws 
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the predetermined image on a plurality of drawing media by 
dividing it into parts based on the positions of the markers. 

This configuration makes it easy to divide an image when 
drawing the image on a large-sized image-forming surface. 
5 Also, the drawing section is a predetermined printer. 

—Also-,- -t£ie__dr :a w_i n g s ect ion is an ink jet printer. 
This configuration makes it possible to do printing, 
relatively unconstrained by surface geometries of the 
image-forming surface . 
10 Also, the preview device further comprises color matching 

section for matching colors between the image displayed by 
the display section and the image drawn by the drawing section . 

This configuration makes it possible to match colors 
between a previewed image and drawn image more accurately. 
15 Also, the preview device is capable of acquiring the 

display information about a plurality of images, judging the 
shape of each image based on the display information, and laying 
out the plurality of images on a drawing surface at a higher 
density. 

20 For example, roughly triangular images can be placed 

upside down alternately. 

This configuration makes it possible to draw images 
efficiently on a drawing surface. 

The phrase "at a higher density" means that the array 
25 pattern of output images is denser than the array pattern of 
input images . The present invention lays out images at a higher 
density than when they are arranged simply. 
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Also, the preview device further comprises cutting 
section for automatically cutting off, or making it easy to 
cut off, images drawn by the drawing section. 

This configuration makes it possible to reduce the 
5 workload of cutting off a drawing medium to be pasted to the 
image-forming surface. Also, it allows the drawing medium 
to be cut off at appropriate cutting positions. 

Also, the preview device further comprises image reading 
section for reading images and is capable of utilizing data 
10 about the images read by the image reading section. 

With this configuration, the preview device can capture 
images, improving convenience. 

For example, the user can capture a name he/she wrote 
by himself /herself and use it in a manner similar to the use 
15 of a seal by printing its image repeatedly. 

Also, at least one of the sections described above is 
configured as a unit separate from the other sections and is. 
capable of communicating with the other sections. 

This configuration makes it possible to operate a specific 
20 section separately from the other sections . For example, the 
drawing section, if provided as a separate pen-type printing 
device, will print on any desired surface. Also, this 
configuration makes it possible to decide installation 
locations of individual section more flexibly. For example, 
25 images can be previewed in Japan and drawn overseas. 

Also, the display section includes a plurality of 
projectors capable of projecting screen images onto the 
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image- forming surface and displays the predetermined image 
usingthe screen imagesprojectedby the individual pro j ectors . 

This configuration makes it possible to display preview 
images appropriately on a larger-sized image-forming surface . 
5 Also, the present inventionprovides an electronic device 

equipped with the preview device set forth in any of claims 
1 to 21. 

Also, the present invention provides an image forming 
apparatus equipped with the preview device set forth in any 
10 of claims 1 to 21. 

Here, drawing an image generally includes drawing an image 
tangibly by printing or the like. 

The present invention displays a screen image on the 
image-forming surface to allow the user to preview how the 
15 image will be drawn and acquires the display state of the image 
being previewed. 

Thus, the user can adjust the screen image to obtain 
intended drawing results . In short, the user can draw an image 
as intended. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG . 1 is a block diagram showing functional configuration 
of a printing device 1 according to the present invention; 
FIG. 2 is a flowchart showing processes for printing on 
25 the printing device 1; 

FIG. 3 is a diagram showing an example of layout used 
to print multiple patterns; 
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FIG. 4 is a diagram showing a stationary printing device 
1 in which a data processor 10, image display unit 20, and 
print unit 30 are housed in a single enclosure; 

FIG. 5 is a diagram showing an example of how the image 
5 display unit 20 is used when it is configured as a separate 
unit; 

FIG. 6 is a diagram showing an example in which 
illustrations of a tree are printed on a letter-size label 
sheet; 

10 FIG. 7 is a diagram showing how a printing device 2 is 

used to print a life-size POP signboard; 

FIG. 8 is a diagram showing how the printing device 2 
is used to print a large signboard; 

FIG. 9 is a diagram showing how a printing device 3 is 
15 used for textile printing; and 

FIG. 10 is a diagram showing how a printing device 4 is 
used to print wallpapers. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 Embodiments of the present invention will be described 

in detail below with reference to drawings. 
(First Embodiment) 

Configuration will be described first. 

FIG. 1 is a block diagram showing functional configuration 
25 of a printing device 1 according to this embodiment. The 
printing device 1 has image display capability for previewing 
print data. 
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In FIG . 1, the printing device 1 comprises a data processor 
10, image display unit 20, and print unit 30. 

First, the data processor 10 will be described. 

The data processor 10 comprises a content data storage 
5 11, content data selector 12, content data transmitter 13, 
print data generator 14, print data transmitter 15, and print 
parameter receiver 16. 

The content data storage 11 stores various content data 
selectable as print data . The content data are inbitmap format 
10 such as JPEG (Joint Photographic Experts Group) format or in 
vector format such as SVG (Scalable Vector Graphics) format. 

The content data selector 12 allows the user to select 
data to be printed from among the content data stored in the 
content data storage 11. In order for the user to select the 
15 data to be printed, the content data selector 12 displays the 
content data, item by item, in sequence on a display device 
such as LCD (Liquid Crystal Display) (not shown) or displays 
a screen of content data at a time to receive the choice of 
data to be printed. 
20 Then, the content data selector 12 sends the selected 

content data to the content data transmitter 13 and print data 
generator 14. 

The content data transmitter 13, which has communications 
capabilities for Bluetooth and other short-range wireless 
25 communications, sends the content data selected via the content 
data selector 12 to a content data receiver 21 of the image 
display unit 20. 
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The print data generator 14 generates print data based 
on the content data sent from the content data selector 12 
and print parameters (described later) sent from the print 
parameter receiver 16 described later. When generating the 
5 print data, the print data generator 14 applies geometry 
transformations (scaling, rotation, transformation, etc.) 
such as affine transformations or color conversion to the 
content data received from the content data selector 12, based 
on the print parameters . Also, the print position is adjusted 

10 so that the print data will be printed in place. 

Furthermore, since content data themselves typically do 
not have a high resolution, when generatingprint data, content 
data with a low resolution is often enhanced to prepare the 
print data with a high resolution. Printing resolution is 

15 determined by user specification or prescribed print quality. 
If print quality of 720 dpi horizontal by 720 dpi vertical 
is specified, the print data generator 14 generates print data 
with a horizontal resolution of 720 dpi and vertical resolution 
of 720 dpi so that the resulting image appears as good as the 

20 preview image. Normally, since the resolution on the 

projection plane of a projector and the like is not very high, 
although the printed image is equal in position, size, etc. 
to the preview image, the printed image has a higher resolution 
than the preview image, resulting in a print of higher quality 

2 5 image. 

Incidentally, the color conversion here is the process 
of adjusting the colors of the content data so as to match 
those of the projected screen image verified by the user. That 
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is, since printed colors do not appear as they should depending 
on the color of the printing surface (projection plane) , the 
colors used for printing is changed according to the color 
of the printing surface so that intended colors will be obtained 
5 after printing. If appropriate corrections cannot be made 
by changing the colors used for printing, the printing surface 
is undercoated with a predetermined color (e.g., white) so 
that intended colors will be obtained after printing. 
Various formats are available for the print data, 
10 including the same format as content data, predetermined 
application data, or printer commands. 

The print data generator 14 sends the generated print 
data to the print data transmitter 15. 

The print data transmitter 15 sends theprint data received 
15 from the print data generator 14 to a print data receiver 31 
of the print unit 30. 

The print parameter receiver 1 6 receives print parameters 
sent from a print parameter transmitter 25 of the image display 
unit 20 and sends them to the print data generator 14. 
20 Next, the image display unit 20 will be described. 

The image display unit 20 comprises the content data 
receiver 21, a projection data generator 22, a projection 
adjuster 23, a projection unit 24, the print parameter 
transmitter 25, and a projection plane information detector 
25 26. 

The content data receiver 21, which has communications 
capabilities for Bluetooth and other short-range wireless 
communications, receives the content data sent from the content 
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data transmitter 13 of the dataprocessor 10 . Then, the content 
data receiver 21 sends the received content data to the 
projection data generator 22. 

The projection data generator 22 determines the mode in 
5 which the content data received from the content data receiver 
21 will be projected, with reference to projection plane 
information (described later) received from the projection 
plane information detector 26 as well as to the projection 
adjustment values (described later) received from the 

10 projection adjuster 23. The projection data generator 22 
makes corrections, as required, inproj ecting the content data . 
The corrections include, firstly, corrections made to the shape 
of the screen image if the screen image is projected at oblique 
angles to the projection plane or if the projection plane is 

15 not level, and secondly, corrections made to the colors of 
the projected image itself in accordance with the color of 
the pro j ection plane if the color of the pro j ection plane makes 
the colors of the screen image look different from the original 
ones . Incidentally, the pro j ection data generator 22 can make 

20 corrections here through data processing of the content data. 

The projection data generator 22 sends the projection 
unit 24 a signal for projecting the screen image in the 
determined mode. 

The projection adjuster 23 varies projection adjustment 

25 values, which are parameters including the focus, size, 

position, projection angle, and color of the screen image to 
be projected, according to user's actions. Regarding the 
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color, for example, hue, lightness, contrast, chroma, etc, 
can be specified, and so on. 

For the projection adjustment values, default values or 
preset values may be used, especially when there is no need 
5 for adjustment or when given content data is projected for 
the first time. Also, before projecting content data, 
projection position or size may be specified in advance using 
a predetermined method. The projection position or size may 
be specified, for example, as follows: a pair of diagonals 
10 which define a rectangle of a projection area may be projected 
onto the projection plane, allowing the user to determine the 
projection position or size, or a pair of diagonals which define 
a rectangle of a projection area may be entered by the user 
in the printing device 1. 
15 To specify the projection adjustment values, amechanical 

method and software-based method are available: the former 
involves the use of an adjustment ring, button, or the like 
while the latter involves displaying an adjustment screen on 
a predetermined display unit. 
20 The projection unit 24 projects a screen image with 

reference to the projection adjustment values received from 
the projection adjuster 23 and based on the signal received 
from the projection data generator 22. In doing so, the 
projection unit 24 makes corrections, as required, in 
25 projecting the content data. The corrections made here are 
optical or mechanical ones, which cannot be made through data 
processing of the content data. 
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The print parameter transmitter 25 acquires print 
parameters based on the projection plane information and 
pro j ection adjustment values concerning the screen image being 
projected and sends them to the print parameter receiver 16 
5 of the data processor 10 . The print parameters acquired here 
may be the projection plane information and projection 
adjustment values themselves or predetermined parameters 
generated from the pro j ectionplane information andproj ection 
adjustment values. 

10 Incidentally, the print parameter transmitter 25 sends 

the print parameters to the print parameter receiver 16 when 
the user verifies the projected screen image and presses a 
predetermined button. 

The pro j ection plane information detector 2 6 is equipped 

15 with various sensors and detects various information 

(projection plane information) about the projection plane. 

The projection plane information contains the color of 
the projection plane, distance to the projection plane, 
inclination of the projection plane (relative angle to the 

20 projection plane), or the like. 

To detect the projection plane information, the 
projection plane information detector 2 6 measures the distance 
to the projection plane or inclination of the projection plane 
with ultrasonic, infrared, or laser sensors and measures the 

25 color of the projectionplane with a CCD (Charge Coupled Diode ) . 
Incidentally, positions and angles can be detected by taking 
measurements with multiple sensors. Also, distances can be 
determined by measuring reflection times of ultrasonic waves 
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or the like using sensors or calculated from the magnification 
and focal distance of a lens . Furthermore, it is also possible 
to acquire the size and position of an image on the projection 
plane using a CCD. That is, if the distance to the projection 
5 plane is known, it is possible to acquire the size and position 
of the image by capturing the image on the projection plane 
using the CCD. 

Next, the print unit 30 will be described. 
The print unit 30 comprises the print data receiver 31 
10 and printout unit 32. 

The print data receiver 31, which has communications 
capabilities for Bluetooth and other short-range wireless 
communications, receives the print data sent from the print 
data transmitter 15 of the data processor 10 . Then, the print 
15 data receiver 31 sends the received print data to the printout 
unit 32. 

The printout unit 32 is equipped with a printer head 
capable of ink jet printing and prints the print data received 
from the print data receiver 31 on the printing surface. 

20 Incidentally, although it has been explained that the 

data processor 10, image display unit 20, and print unit 30 
are separate unit witch communicate with each other, they may 
be configured as an integral unit. Also, the components of 
the printing device 1 may be distributed over different sites 

25 and connected via a network. 

Now, operation will be described. 

FIG. 2 is a flowchart showing processes for printing on 
the printing device 1. 
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In FIG. 2, the printing device 1 allows the user to select 
content data to be printed (Step SI) . 

Then, the printing device 1 sends the selected content 
data from the data processor 10 to the image display unit 20 
(Step S2) . The image display unit 20 receives the content 
data and projects it (Step S3) . 

Next, the printing device 1 makes the projection plane 
information detector 26 of the image display unit 20 acquire 
projection plane information (Step S4) and performs a 
calibration process to match colors between the previewed image 
and printed image based on the color of the projection plane 
acquired as a projection adjustment value (Step S5) . As a 
method for calibration, a method described in Japanese Patent 
Laid-Open No. 2003-50572 can be used, for example. 

Then, the printing device 1 makes the projection adjuster 
23 vary the projection adjustment value in response to user 
actions (Step S6) . 

Next, the printing device 1 generates projection data 
with reference to the projection plane information and 
projection adjustment value andbasedon the content data (Step 
S7) . 

Then, the printing device 1 projects the projection data 
onto the projection plane (Step S8) and judges whether the 
projected image is confirmed as an image to be printed (Step 
S9) . This judgment may be made based on whether the user has 
verified the projected image and pressed a predetermined 
button. 



If it is judged in Step S9 that the projected image is 
not confirmed as an image to be printed, the printing device 
1 goes to Step S6. On the other hand, if it is judged that 
the projected image is confirmed as an image to be printed, 
5 the printing device 1 sends the projection plane information 
and projection adjustment value as print parameters from the 
image display unit 20 to the data processor 10 (Step S10) . 

Next, the printing device 1 makes the data processor 10 
receive the print parameters (Step Sll) and allows the user 

10 to specify how many times the print data should be generated 
(the number of times the image should be printed) (Step S12) . 

Then, based on the print parameters, the printing device 
1 generates the print data a predetermined number of times 
(Step SI 3) and judges whether the screen image will be projected 

15 to another projection plane (Step S14) . This judgment may 
be made based on whether the user has pressed a control button 
to specif y pro j ection again. Incidentally, to generate print 
data multiple times, it can be generated only once and its 
copies can be used for the rest of the printing. 

20 If it is judged in Step S14 that the screen image will 

be projected to another projection plane, the printing device 
1 goes to Step S4 . On the other hand, if it is judged that 
the screen image will not be projected to another projection 
plane, the printing device 1 judges whether other content data 

25 is selected (Step S15) . This judgment may be made based on 
whether the user has taken some action (pressed a button or 
the like) to change the object to be printed. 
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If it is judged in Step S15 that other content data is 
selected, the printing device 1 goes to Step SI . On the other 
hand, if it is judged that no other content data is selected 
and if there are multiple items of print data, the printing 
5 device 1 lays out the print data automatically (Step S16) . 
The printing device 1 lays out the print data according to 
the shapes of the printing paper and image to be printed in 
such a way as to make effective use of the printing surface. 
In other words, the printing device 1 lays out the print data 

10 so as to print the image at a higher density. For example, 
when printing multiple images on letter-size printing paper, 
the printing device 1 performs layout in such a way that all 
the images fit in the printing paper. Specifically, if the 
images are roughly triangular as shown in FIG. 3, the printing 

15 device 1 lays out the images upside down alternately. Also, 
when printing a label sheet, individual images may be placed 
lengthways or sideways whichever is more convenient for them 
to be cut out. 

Incidentally, when multiple items of print data are laid 

20 out, the printing device 1 treats the entire layout which forms 
an overall image as a single item of print data. 

Next, the printing device 1 sends the print data from 
the data processor 10 to the print unit 30 (Step S17) . The 
print unit 30 receives the print data (Step S18) . 

25 Then, the printing device 1 prints the print data (Step 

S19) based on the layout prepared in Step S15 and finishes 
processing. 
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Now, description will be given of how printing is done 
on a specif icprinting device configuredas theprinting device 
1. 

FIG. 4 shows a stationary printing device 1 in which the 
5 data processor 10, image display unit 20, and print unit 30 
are housed in a single enclosure. 

In the printing device 1 in FIG. 4, printing paper is 
placed on the upper surface (hereinafter referred to as the 
"paper mounting surface") of the data processor 10 which 

10 constitutes the main unit and images are printed as the print 
head moves over the paper mounting surface . A pro j ector which 
corresponds to the image display unit 20 is installed at a 
predetermined height from the paper mounting surface. It can 
move in a plane located at the predetermined height from the 

15 paper mounting surface. Incidentally, the distance between 
the projector and the paper mounting surface in the printing 
device 1 may be made variable. However, simple arithmetic 
operations canbe used in generating print data if this distance 
is constant. 

20 With the above configuration, the user prints his/her 

address ("Suwa City, Nagano Prefecture" in this case) on the 
printing device 1 as follows. 

First, the user places printingpaper on the paper mounting 
surface and newly enters his/her address or selects it from 
25 stored content data in the data processor 10. 

Consequently, characters "Suwa City, Nagano Prefecture" 
are projected from the projector onto the printing paper for 
preview. 
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Then, the user makes adjustments so that the projected 
characters "Suwa City, Nagano Prefecture" match the intended 
position, size, etc. on the paper. 

When the user verifies that the projected image matches 
5 the intended position, size, etc. and presses an Enter button, 
the printing device 1 prepares an image equal in position, 
size, etc. to the projected image and prints the "characters 
"SuwaCity, Nagano Prefecture" exactly like the projected image, 
by moving the print head. 

10 FIG. 5 shows an example of how the image display unit 

20 is used when it is configured as a separate unit . The image 
display unit 20 in FIG . 5 is a portable type and is capable 
of projecting a preview image while being held in hand. It 
can be made more convenient if equipped with capabilities to 

15 correct for hand movements by mechanically detecting 

acceleration or by detecting images. By making the image 
display unit 20 portable in this way, it is possible to.., 
drastically increase the flexibility in selecting the 
projection plane for preview. 

20 In FIG. 5, a PC (Personal Computer) or the like which 

serves the function of the data processor 10 sends content 
data related to an illustration of a tree to the image display 
unit 20 via Bluetooth or the like. 

The image display unit 20 is a small LCD (Liquid Crystal 

25 Display) projector. It projects the received illustration 
of a tree onto a cup or a toothbrush. 
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The user adjusts the size of the illustration by rotating 
a zoom ring. Either an optical zoom or digital zoom may be 
used. 

When the illustration is adjusted to the intended size, 
5 the user presses the Enter button. Incidentally, an user 
interface in the image display unit 20 may be not only a visual 
one which displays images, but also an auditory one. 

Consequently, the projection plane information and 
projection adjustment value in the current state are sent to 
10 the data processor 10 via Bluetooth or the like and print data 
is generated. If the desired number of copies are specified, 
multiple copies of the illustration can be printed. 

In FIG. 5, it is assumed that four labels for the cup 
and three labels for the toothbrush will be printed. In this 
15 case, first the illustration is projected onto the cup, the 
size is adjusted, and four copies are specified, and then the 
illustration is projected onto the toothbrush, the size is 
adjusted, and three copies are specified. 

Next, the print unit 30 prints the print data generated 
20 by the data processor 10. It is assumed here that the 

illustration of the tree is printed on a letter-size label 
sheet. Then, the print data with the illustration of the tree 
laid out in a predetermined manner is sent from the data 
processor 10 to the print unit 30, which then prints the print 
25 data using the predetermined layout. 

FIG. 6 shows an example of the results of printing. In 
the figure, all the copies of the illustration are printed 
on the letter-size label sheet. 
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Incidentally, when the illustration of the tree isprinted, 
it will be convenient if the printer which constitutes the 
print unit 30 cuts each copy of the illustration automatically 
or perforates the sheet to make it easier to cut off the copies . 
5 Also, by matching colors between the surface of the label sheet 
and projection plane, it is possible to reduce the difference 
between the previewed image and actually printed image. 

When projecting an image onto a curved surface of a cup 
or the like, conditions of the curved surface is measured by 

10 sensors andprint data is corrected. For example, whenpasting 
an illustration on a cup, if an image slightly larger in the 
right-and-left direction than the projected image is printed 
and pasted on the cup, it is possible tomatch appearance between 
the projected image and printed and pasted illustration. 

15 Also, a small printer serving as the print unit 30 may 

be attached to the image display unit 20 to form an integral 
unit . In that case, the pro j ected image can be printed directly 
on the printing surface of the cup or toothbrush. However, 
in the apparatus which incorporates the small printer, the 

20 distance between the apparatus and projection plane during 
previewing may differ from the distance between the apparatus 
and printing surface during printing. Even in that case, the 
print data must be printed exactly like the previewed image. 
Thus, by detecting the distance between the apparatus and 

25 projection plane during previewing as well as the distance 
between the apparatus and printing surface during printing 
and making corrections to the print data, it is possible to 
print an image of the appropriate size. 
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As described above, the printing device 1 according to 
this embodiment displays a previewed image on a surface for 
printing (printing paper or a surface for pasting a print) 
to allow the user to preview how content data will be printed, 
5 As the user adjusts the previewed image to obtain intended 
results, an image identical to the image being previewed is 
printed on the printing paper. 

This makes it easy to print desired content. 
Specifically, since the user can verify an image displayed 
10 on the surface on which the image will be actually printed 
or pasted, it is possible to prevent the actual print produced 
or pasted on the printing paper from differing from the user 1 s 
expectations . 

Also, when printing a plurality of images which will be 
15 cut off when used, the printing device 1 according to this 
embodiment prints them after laying them out efficiently on 
printing paper according to their shapes or the like. This 
eliminates waste of printing paper. 

Furthermore, the printing device 1 can be made more 
20 convenient by cutting each print automatically or perforating 
the printing paper to make it easier to cut off the prints. 

Incidentally, in addition to ink jet printers, this 
embodiment is applicable to laser printers, thermal transfer 
printers, and various other types of printers. However, the 
25 ink jet printer, which accommodates some irregularities on 
the printing surface, can print on a wide range of printing 
surfaces . 
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Also, the image display unit 20 may be an LCD type, DLP 
(Digital Light Processing) type, or other type of projector; 
or a projector using LED (Light Emitting Diode) hologram or 
laser. Light may be projected either from the front surface 
5 or rear surface of the printing paper. 

Besides, the printing device 1 or the image display unit 
20 in FIG. 5 may be equipped with a scanner , and images captured 
by the scanner may be used as content data. 

The communications means in the data processor 10, image 

10 display unit 20, and print unit 30 may employ wire 

communications such as USB (Universal Serial Bus) , IEEE1394, 
or lOBaseT or wireless communications such as IEEE802.11x, 
Bluetooth, or optical communications. 

Incidentally, although it has been explained that 

15 according to this embodiment the image display unit 20 projects 
an image onto the printing surface to allow the user to preview 
the results of printing, it is also possible to superimpose 
a transmissive display over the printing paper, allowing the 
user to preview the video image presented on the display. 

20 Also, this embodiment has cited an example in which 

distances are calculated from the magnification and focal 
distance of the lens, but then the lens must be focused on 
the projection plane in advance. Available focusing methods 
include a method which involves operating a focus ring manually 

25 and a method which involves focusing on the center of the 
projected image. 
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Also, the projection display, transmissive display, 
printing device, etc. according to this embodiment may be 
either monochromatic or polychromatic. 

Furthermore, the present invention can also be used to 
5 embroider cloth on a sewing machine and print images on 
photographic paper. 

(Second Embodiment) 

Next, a second embodiment of the present invention will 
be described. 

10 A printing device 2 according to this embodiment is 

configured to make large prints such as signboards, posters, 
and POP (point-of-purchase) signboards. 

Incidentally, the functional configuration of the 
printing device 2 is the same as that of the printing device 
15 1 in FIG. 1, and thus description thereof will be omitted here 
by referring to FIG. 1. 

Also, the operation of the printing device 2 is the same 
as that of the printing device 1 in FIG. 2, and thus description 
thereof will be omitted here by referring to the flowchart 
20 in FIG. 2. 

Now, description will be given below of how printing is 
done on a specific printing device configured as the printing 
device 2. 

FIG. 7 shows how the printing device 2 is used to print 
25 a life-size POP signboard. 

In FIG. 7, the printing device 2 comprises a PC which 
corresponds to the data processor 10, projector which 
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corresponds to the image display unit 20, and large format 
printer (LFP) which corresponds to the print unit 30. 

The projector projects an advertisement onto the POP 
signboard and the user adjusts the previewed image of the 
5 advertisement by operating the projector so that intended 
position, size, etc. will be obtained on the paper. The 
projector acquires the contour of the POP signboard as a piece 
of projection plane information. 

The user verifies that the projected image matches the 
10 intended position, size, etc. and decides on the image to be 
printed (e.g., presses an Enter button) . Then, supposing a 
contour of the same size as the real POP signboard, on the 
printing paper, the PC generates print data to produce an image 
equal in position, size, etc. to the projected image, within 
15 the contour. The large format printer prints the 

advertisement exactly as it is shown by the projected image 
according to the processing results produced by the PC. v> 
The advertisement is printed on square printing paper, 
cut to conform to the contour of the POP signboard, and pasted 
20 to the POP signboard. 

The advertisement may be printed on the large format 
printer in such a way that the user can distinguish the contour 
of the POP signboardprovided tentatively on the printing paper . 
For example, lines which indicate the contour of the POP 
25 signboard may be printed on the printing paper or margins 
outside the contour may be filled with a predetermined color 
or pattern. 
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In this way, printing the contour of the POP signboard 
such that the user can recognize it will make it easier to 
cut the advertisement to conform to the contour of the POP 
signboard. 

5 As described above, when printing an advertisement for 

a POP signboard on the printing device 2, the size of the 
advertisement can be previewed easily on the POP signboard 
on which the advertisement will be actually pasted and he 
advertisement can be printed exactly as previewed. 
10 Now, description will be given of how an advertisement 

is printed on a large signboard (e.g., a few meters square) . 

FIG. 8 shows how the printing device 2 is used to print 
a large signboard. 

The equipment configuration in FIG. 8 is the same as that 
15 in FIG. 7. 

In FIG. 8, to produce a print, the projector projects 
an advertisement onto the large signboard and the user adjusts 
the previewed image of the advertisement by operating the 
projector so that intended position, size, etc. will be 
20 obtained on the paper. 

Markers are provided at predetermined positions on the 
projectionplane (which carries the advertisement ) of the large 
signboard to divide the projection plane into areas of a 
predetermined size . The markers are located at lattice points 
25 which divide both length and width of the projection plane 
of the large signboard virtually into intervals of 1 meter 
of less. They consist of protrusions which have a 
predetermined height or circles drawn in a predetermined color, 
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for example. The projector acquires the positions of the 
markers in the pro j ected image as pro jectionplane information. 

Returning to FIG. 8, when the user verifies that the 
projected image matches the intended position, size, or the 
5 like and decides on the image to be printed (e.g., presses 
an Enter button) , the PC generates print data to produce an 
image equal in color, size, etc. to the projected image. 

The advertisement in the large signboard is larger in 
size than the largest printing paper which can be handled by 
10 the large format printer, and thus the PC divides the 

advertisement and prints on multiple sheets of printing paper. 

Specifically, the PC divides the advertisement into areas 
each of which fit in printing paper of a predetermined size 
according to the positions of the markers acquired as the 
15 projection plane information. 

Then, the large format printer prints each of the divided 
areas in the printing paper of the predetermined size according 
to the processing results produced by the PC. The images 
printed on individual sheets of printing paper are equal in 
20 color, size, etc. to the corresponding parts of the projected 
image of the advertisement pro j ected onto the pro j ection plane 
of the large signboard. For example, in FIG. 8, a projected 
image which contains a rear right wheel of an automobile 
(hereinafter referred to as the "lower right projected image" ) 
25 is projected onto the lower right area of the large signboard. 
The PC divides the advertisement and the large format printer 
prints that part of the advertisement which corresponds to 
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the lower right projected image in the projected color and 
size . 

Thus, the images printed on the individual sheets of 
printing paper by the large format printer are pasted in place 
5 on the large signboard, thereby forming an image of the 
advertisement exactly like the projected image. 

As described above, when printing an advertisement on 
a large signboard using the printing device 2, the size and 
the like of the advertisement can be previewed easily on the 
10 large signboard on which the advertisement is pasted and the 
advertisement can be printed exactly as previewed. 

Also, when dividing and printing an advertisement on 
multiple sheets of printing paper, the advertisement can be 
divided easily and appropriately using markers provided on 
15 the projection plane of the large signboard. 

Incidentally, when a previewed image is projected onto 
a large area such as a large signboard, the content data ? such 
as an advertisement to be pro j ectedmay be divided into multiple 
parts and individual pieces of content data may be projected 
20 from different projectors to form a single previewed image. 
For example, previewed images may be projected onto the left 
and right halves of a large signboard to form a single previewed 
image . 

(Third Embodiment) 
25 Next, a third embodiment of the present invention will 

be described. 

A printing device 3 according to this embodiment is 
configured to print clothing material with dyes. 
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Incidentally, although the printing device 3 is 
configured such that the image display unit 2 0 projects a 
previewed image onto clothing material and that the print unit 
30 prints the clothing material with dyes, the basic functional 
5 configuration of the printing device 3 is the same as that 
of the printing device 1 in FIG. 1, and thus description thereof 
will be omitted here by referring to FIG . 1. 

Also, the operation of the printing device 3 is the same 
as that of the printing device 1 in FIG . 2 , and thus description 
10 thereof will be omitted here by referring to the flowchart 
in FIG. 2. 

Now, description will be given below of how printing is 
done on a specific printing device configured as the printing 
device 3. 

15 FIG. 9 shows how the printing device 3 is used for textile 

printing . 

In FIG. 9, the printing device 3 comprises a PC which 
corresponds to the data processor 10, projector which 
corresponds to the image display unit 20, and textile printer 

20 which corresponds to the print unit 30. 

The projector projects a print pattern onto the clothing 
material and the user adjusts the projected image of the print 
pattern by operating the projector so that intended color, 
position, size, etc . will be obtained on the clothing material . 

25 When the user verifies that the projected image matches 

the intended color, position, size, or the like and decides 
on the image to be printed (e.g., presses an Enter button), 
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the PC generatesprint data toproduce an image equal inposition, 
size, etc. to the projected image. 

Then, the textile printer prints the print pattern exactly 
like the projected image, on the clothing material according 
5 to the processing results produced by the PC. 

Specifically, a roll of cloth — i.e., wound clothing 
material — to be printed is mounted on the textile printer and" 
the clothing material is feed sequentially from the roll . The 
textile printer is provided with an area for projecting the 

10 print pattern from the projector to the clothing material, 
allowing the user to verify the print pattern projected from 
the projector. When the user verifies the print pattern and 
decides on the projected pattern (image to be printed), the 
textile printer moves an ink head sideways and sprays dyes 

15 from the ink head while feeding the clothing material 

sequentially. Consequently, the print pattern exactly like 
the projected image is printed on the clothing material.^ 
Here, color matching between the image (preview image) 
projected onto the clothing material and the printed pattern 

20 is especially important for textile printing. 

As a method for the color matching, the calibration 
technology described in Japanese Patent Laid-Open No. 
2003-50572 can be used. Specifically, this method involves 
projecting a test pattern, reading the projected test pattern 

25 with a colored-light sensor employing a CCD or the like, and 
calibrating the colors of the projected image so as to match 
reference values. Textile printers can similarly be 
calibrated by printing a test pattern onto clothing material, 
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reading the test pattern with a color-light sensor, and making 
the colors of the printed pattern match the reference values. 

In this way, color matching can be performed by matching 
the colors of a projected image and the colors of a printed 
pattern to reference values. 

Another method involves comparing the colors of a 
projected image and the colors of a printed pattern visually 
and making adjustments so that they match each other. Since 
thismethodmatches colors directlybasedonuser ' s impressions, 
it can perform color matching more reliably without error. 

As described above, the printing device 3 according to 
this embodiment projects a preview image of a print pattern 
onto clothing material, allowing the user to adjust it to the 
color, position, size, etc. he/she wants before printing the 
print pattern. 

That is, this embodiment allows the user to preview the 
print pattern on the clothing material on which it will be 
actually printed and to verify design including the textures 
of the clothing material. 

Thus, this embodiment can increase the flexibility and 
accuracy of design and improve quality. Furthermore, since 
the design and printing can be verified in a short period of 
time, this embodiment can shorten the delivery time of clothing 
material in terms of the shorter time required for textile 
printing . 

(Fourth Embodiment) 

Next, a fourth embodiment of the present invention will 
be described. 
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A printing device 4 according to this embodiment is 
configured to print wallpapers for buildings. 

Incidentally, the functional configuration of the 
printing device 4 is the same as that of the printing device 
5 1 in FIG. 1, and thus description thereof will be omitted here 
by referring to FIG. 1. 

""Krso7""tEe operation of the printing device 4 is the same 
as that of the printing device 1 in FIG. 2, and thus description 
thereof will be omitted here by referring to the flowchart 
10 in FIG. 2. 

Now, description will be given below of how printing is 
done on a specific printing device configured as the printing 
device 4. 

FIG. 10 shows how the printing device 4 is used to print 
15 wallpapers. 

In FIG. 10, the printing device 4 comprises a PC which 
corresponds to the data processor 10, projector which, 
corresponds to the image display unit 20, and wallpaper printer 
which corresponds to the print unit 30. It is assumed here 
20 that the wallpaper printer is a special-purpose printer 
installed at a printing plant. 

With this configuration, when choosing wallpapers to hang 
in a new house under construction, for example, the projector 
is brought into the house under construction, and previewed 
25 images are projected onto the walls on which the wallpapers 
are to be put up. The content of the images to be projected 
may be supplied on a storage medium such as a memory card. 
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Using the previewed images on the wall surfaces, the 
order er of wallpapers selects the wallpapers of his/her desired 
colors, patterns, etc. 

Furthermore, the projector acquires projection 
adjustment values and projection plane information for the 
previewed images verified by the orderer and stores them on 
a storage medium such as a memory card. 

Subsequently, the storage medium is sent to the printing 
plant where the wallpaper printer is installed. Then, the 
projection adjustment values andpro jectionplane information 
are read out of the storage medium by a PC connected to the 
wallpaper printer. 

The PC generates print data based on the projection 
adjustment values and pro j ection plane information read out. 

Then, the wallpaper printer prints the wallpapers exactly 
as shown by the projected images according to the processing 
results produced by the PC. 

As described above, the printing device 4 according to 
this embodiment makes the projector project patterns and the 
like of actual wallpapers onto the wall surfaces on which 
wallpapers will be put up, allowing the orderer to adjust them 
to the colors, patterns, etc. he/she wants before printing 
the wallpapers. 

In particular, after walls and windows are constructed 
in a new house under construction, this embodiment allows the 
user to preview wallpapers on wall surfaces and select the 
colors andpatterns of the wallpapers taking into consideration 
the atmosphere of rooms. 



- 37 - 



Thus, selections can be made more accurately based on 
the impressions of the wallpapers actually hung on the wall 
surfaces than when selecting wallpapers using small samples 
as is conventionally the case. 
5 Incidentally, in addition to colors and patterns, 

textures constitute an important design factor in the case 
of wallpapers. By projecting previewed images onto white 
paper with the same textures as the wallpaper material which 
will be printed, this embodiment allows wallpapers to be 
10 selected taking their textures into consideration. 
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